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This  project  saw  some  unexpoctud  successes,  and  some  even  more  unexpected  failures. 

Chief  among  the  latter  was  our  total  failure  to  replicate  Williams’  observations  of 
receptoral  aliasing,  either  in  the  fovea  or  the  parafovea.  Despite  much  communication 
between  us  and  Williams,  no  explanation  of  this  discrepancy  has  been  found.  We  pre¬ 
sent  substantial  evidence  below  to  eliminate  the  possibility  of  technical  failure  in 
our  experiments.  Unable  to  study  aliasing  directly,  we  pursued  a  very  different 
approach  to  the  problems  of  retinal  geometry  and  aliasing:  we  studied  methods  to 
directly  nap  the  parafoveal  visual  field  into  its  constituent  summation  areas  (pre¬ 
sumably  receptive  fields).  Aitheugh  we  have  not  fully  solved  the  very  difficult 
problem  of  eye-movements,  sever.il  successful  studies  were  performed,  notably;  (1)  the 
development  of  a  precise  new  method  for  measuring  fixation  accuracy  using  afterimages, 
and  (2)  studies  of  spatial  sunm-ation  For  Isolumlnant  spots  in  the  parafovea.  In 
addition,  a  computer  model  wr -  designed  that  produces  sample  ganglion  cell  lattices 
and  models  the  process  of  chi  -tic  Identification.  Finally,  we  diverged  considerably 
from  the  original  focus  of  ti  iject  to  design  what  we  believe  to  be  the  T..ost  powerfi  1 

stimulus  display  for.visula  re-.jrch  currently  ailable.  This  Is  now  a  commercial 
nrndiirF.  tihotjini*  both  scicntxtlc  r.nd  ilnancial  .  ccess. 
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This  project  saw  some  unexpected  sticcesses ,  and  some  even  note  unexpected 
failures,  diief  among  the  latter  was  our  total  failure  to  r^licate  Hilliams* 
cdaservaticns  of  receptoral  aliasing,  either  in  the  fovea  or  the  parafovea. 
Despite  much  ccmnunication  between  us  and  Williams,  no  explanatim  of  this 
discrepancy  has  been  found.  We  present  substantial  evidence  below  to  eliminate 
the  possibility  of  technical  failure  in  our  experiments.  Unable  to  study  aliasing 
directly,  we  pursued  a  very  different  approach  to  the  prdolems  of  retinal 
geometry  and  aliasing:  we  studied  methods  to  directly  map  the  parafoveal  visual 
field  into  its  constitusnt  sxximation  areas  (presianably  receptive  fields). 
Although  we  have  not  fully  solved  the  very  difficult  problem  of  eye-movements, 
several  successful  studies  were  performed,  notably;  (1)  the  development  of  a 
precise  new  method  for  measuring  fixation  accuracy  using  afterimages,  and  (2) 
studies  of  spatial  sutimation  for  isoluidnant  spots  in  the  parafovea.  In 
addition,  a  computer  model  was  designed  that  produces  sanple  ganglion  cell 
lattices  and  models  the  process  of  duromatic  identification.  Finally,  we 
^verged  considerably  from  the  original  focus  of  the  project  to  design  what  we 
believe  to  be  the  most  powerful  stimulus  display  for  visual  research  currently 
available.  This  is  now  a  commercial  product,  showing  both  scientific  and 
financial  success. 


I.  COTLINE  OF  RESEXKS  ACrnmy 


h.  Receptoral  Aliasing  and  the  Optical  Bench 

The  first  objective  was  the  constniction  of  the  laser  interferometer.  This 
was  begun  in  January  *89,  and  proceeded  rapidly.  It  was  clear  within  several 
weeks  that  we  could  project  fringes  m  the  retina,  and  that  problens  of  vibraticx) 
and  alteration  were  not  major  issues.  The  design  of  the  interferometer  is  a  new 
one,  provided  to  us  by  Dave  Williams,  who  was  constructing  a  similar  device  at 
tl»  same  time.  This  design  offers  a  distinct  advantage  over  previous 
interferometers  in  that  the  two  interfering  beams  traverse  the  same  optical  path, 
only  in  opposite  directions.  This  cancels  much  of  the  effect  of  vibration. 

Several  problems  surround  the  interferometer.  The  interferometer  depends 
crucially  on  the  ability  of  its  polarizing  beam-splitter  cubes  to  separate  the 
beam  into  opposing  polarizations  with  >99.9%  purity.  Both  we  and  Dave  Williams 
became  aware  simultaneously  that  the  cubes  used  fall  far  short  of  their 
specifications  in  this  regard.  The  result  of  this  crosstalk  between  the 
polaurized  beams  is  that  we  cannot  reduce  the  fringe  contrast  below  about  4%. 
Although  we  devised  several  possible  solutions,  the  issue  did  not  present  an 
actual  limitation  on  our  research  and  so  was  of  no  practical  consequence. 

A  much  more  serious  problem  is  apparently  (after  much  study)  not  of  a 
technical  nature.  A  central  assurption  of  our  proposal  was  that,  having 
duplicated  Williams'  apparatus,  we  would  readily  replicate,  and  then  extend,  his 
reported  findings.  This  never  happened.  The  original  discrepancy  between  out 
respective  results  (predating  this  proposal)  was  that  we  found  that  orientation 
discrimination  at  7  degrees  parafoveal  ceas^  at  about  19  c/deg,  tdnile  Williams 
reported  discrimination  to  about  25  c/deg.  The  issue  is  an  important  one  since 
the  discrindnatioi  limit  is  the  operational  definition  of  the  onset  of  aliasing. 
Thus  our  subjects  appear  to  be  observing  with  a  lattice  with  about  twice  the 
spacing  of  Williams'.  There  is  still  no  good  explanation  for  this  discrepancy. 

To  our  considerable  surprise,  the  use  of  interference  fringes  not  (xily 
failed  to  eliminate  the  above  discrepancy,  but  we  found  that  we  could  not  even 
replicate  Williams'  published  results  in  f  oveal  viewing  ("zebra  stripes").  Above 
about  60  c/deg  our  fringes  become  undetectable  and  remain  so  at  all  higher 
frequencies.  We  are  not  alone  in  this;  at  least  one  other  grox^  has  seriously 
tried  to  replicate  Williams  and  failed  (personal  comiunication:  researdier  wishes 
to  remain  anonymous).  We  have  discussed  this  many  times  and  at  length  wioh 
Williams.  The  only  explanation  fdii<di  was  forthcoming  was  the  possibility  of 
unobserved  high-frequmcy,  low-amplitude  vibrations  in  our  system.  The  problem 
with  such  vibrations  is  that  they  could  be  quite  unobservable  at  low  frequencies, 
yet  a  vibration  of  the  pattern  whose  amplitude  is  comparable  to  the  actxial  fringe 
spacing  (NOT  the  observed  spacing,  xdiich  may  be  2  orders  of  magnitude  larger) 
would  reduce  the  fringe  contrast  (and  that  of  the  observed  alias)  to  near  zero. 
Having  recently  acquired  a  graduate  student  who  is  qxiite  unable  to  see  aliasing, 
Williams  is  now  much  more  receptive  to  the  idea  of  individual  differences.  The 
nature  of  these,  however,  remains  entirely  obscure. 

Possible  sources  of  such  vibraticxi  fall  into  two  classes;  1)  intrinsic  to 
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ths  apparatus,  and  2}  failure  of  vibration  isolation.  Intrinsic  vibrations  would 
cnanate  from  electrical  devices  on  the  optical  table.  These  include  1}  the 
laser,  2)  the  acousto-optic  modulators,  and  3)  the  stepper  motors  which  adjust 
spatial  frequency  and  orientation.  The  first  two  of  these  cannot  readily  be 
changed,  since  they  are  essential  to  the  operation  of  the  apparatus.  Lasers, 
however,  are  not  considered  to  be  a  source  of  vibration,  aivl  the  a/o  modulators 
produce  infinitesimal  vibrations  at  40  Mhz;  such  vibrations  would  not  propagate 
far  fron  their  source.  The  stepper  motors,  however,  are  energized  continuously 
at  60  Hz,  and  are  directly  connected  to  beam-deflecting  mirrors;  tl^y  seem  a 
prime  candidate.  However,  this  vibration  is  readily  eliminated  by  uz^lugging  the 
steppers  and  making  adjustments  manually.  This  had  no  effect  m  our  results. 

The  obvious  path  to  vibration  isolation  —  purchase  of  an  isolated  table  - 
-  W21S  not  economically  feasible.  Williams  solved  this  problem  by  using  a  very 
rigid  st^port  and  suspending  the  actual  table  on  four  motor-scooter  inner-tubes. 
CXir  original  apparatus  used  a  mattress  to  isolate  the  table;  perhaps  this  is 
inadequate.  We  have  therefore  gone  to  a  two-stage  vibration  filter.  The  first 
stage  is  the  mattress  with  a  400  pound  steel  plate  resting  on  it.  This  stage  has 
a  resonant  frequ^cy  of  about  2  Hz,  which  is  unusually  good  for  a  'anall  table 
(24“  X  48").  The  second  stage  is  much  lighter  (decoupling  it  from  the  first). 
It  consists  of  four  inner-tubes  resting  on  the  steel  plate  and  supporting  a  2" 
plywood  sheet  which  holds  the  actual  optical  table.  Finally  th.e  whole  apparatus 
rests  on  a  slab  floor.  Thus  our  isolatioi  systan  would  seem  to  be  at  least  as 
effective  as  Williams'. 

Despite  all  of  the  above  efforts,  our  results  remained  unchanged.  At  this 
point  we  doubted  whether  vibration  was  in  fact  the  cause  of  our  diff.lculties. 
We  devised  the  following  test  of  the  apparatus,  which  shows  definitely  that  hinh- 
frequency  fringes  are  being  produced.  There  is  no  reascm  «^y  the  fringes  must 
be  projected  on  the  retina.  Instead  we  projected  them  directly  on  the  sensitive 
element  of  a  OCD  camera.  By  moving  the  camera  to  larger  distances  the  fringes 
could  be  made  any  convenient  size.  Figure  1  shows  fringes  vduch  would  have  had 
spatial  frequencies  of  10  c/deg  and  150  c/deg  on  the  retina.  Ihe  10  c/deg 
grating  is  clearly  visible;  the  image  of  the  150  c/deg  grating,  however,  is  an 
alias!  The  Nyquist  limit  for  our  CCD  caanera  is  about  80  c/deg.  Note  that  the 
contrast  of  the  alias  is  little  reduced  over  that  of  the  low  frequency  fringe; 
this  can  happen  only  if  the  contrast  of  the  150  c/deg  fringe  remains  high. 
Clearly,  then,  high  frequency  gratings  are  not  being  lost  to  vibration  or  any 
other  cause. 

Although  it  has  not  reproduced  clearly  in  Figure  1,  there  is  a  lot  of 
diffractioi  noise  in  the  image,  presunably  from  scattering  by  imperfections  in 
the  optics.  We  have  done  many  thorough  cleanings  of  the  optics,  to  try  to  reduce 
this.  In  fact,  however,  this  noise  problem  is  quite  small  compared  to  wht 
happens  when  the  gratings  are  viewed  by  the  living  eye.  In  this  case,  every 
piece  of  detritus  in  the  aqueous  humor,  and  every  irregularity  on  any  of  the 
optical  surfaces  of  the  eye  produces  a  clear  inage  on  the  retina.  This  is  normal 
Uhen  viewing  by  coherent  light.  The  noise  level  from  these  sources  appears 
substantial,  but  there  is  no  obvious  way  to  act\ally  measure  it  since  it  is 
entirely  «itoptic;  perhaps  the  more  subtle  Moire’  fringes  are  being  totally 
masked.  Of  the  three  noisy  optical  svirfaces  in  the  eye  (the  corneal  surface,  and 
the  two  lens  surfaces)  it  is  possible  to  eliminate  one  by  focussing  the  laser 
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Figure  I  Interference  fringes  projected  onto  a  CCD  camera.  Left  side:  10  cpd 
spatial  frequency  at  plane  of  retina.  Right  side:  alias  of  150  cpd. 


directly  on  that  surface.  The  comeal  surface  is  the  dirtiest,  so  we  focus 
on  this  one,  but  the  iirprovemait  is  by  no  nieans  drarnatic. 

> 

At  this  point,  our  efforts  in  this  direction  have  met  with  a  dead  stj^e. 
If  we  are  unable  to  observe  aliasing  directly  (i.e.  "zebra  stripes  )  then  there 
is  little  we  can  do  which  we  have  not  done  previously  with  ordinary  displays. 
We  reluctantly  left  the  study  of  aliasing  with  interference  fringes  for  other 
related  investigaticais . 


B.  Happing  the  Retinal  Mosaic:  the  problem  of  eye  movements 

This  overall  project  deals  with  a  variety  of  indirect  methods  for  studying 
the  retiMl  mosaic,  either  receptoral  or  neural.  All  of  our  previous 
however,  approaches  the  problem  from  the  spatial  fregu^cy  aspect  (e.g.  the 
measurement  of  Nyguist  f reqwsicies . )  Giv«i  the  difficulties  described  above,  we 
decided  it  would  be  useful  to  work  in  the  spatial  domain,  by  <Urectly  mapping  (^e 
functional,  retinal  mosaic  using  the  detection  of  small  points  of  light.  The 
foveal  cone  lattice  is  too  dmse  to  map  relative  to  the  large  point-spread 
function  (Jennings  and  Charman,  1981),  but  in  the  p^afovea  the  lattice  density 
falls  very  sharply,  while  optical  quality  is  only  slightly  reduced.  We  recently 
(Smith  and  Cass,  19899)  published  data  on  spatial  sumnation  in  the  parafovea, 
which  suggests  that  simnation  aea*.  are  about  3'  in  diameter.  Our  measurements 
of  the  Nyquist  limit  (Smith  and  Cass,  1987)  offer  a  (^rect  measi^anent  of 
parafoveal  lattice  spacing  which  is  also  about  3'.  While  these  figures  are 
certaunly  imprecise,  they  are  accurate  aiough  to  suggest  two  things.  1)  Both  the 
sunmaticMi  area  and  lattice  spacing  are  considerably  larger  that  the  point-spread 
function  (about  1.2'),. suggesting  it  might  be  possible  to  probe  these  structure 
with  tiny  points  of  light.  2)  Since  their  separation  and  diameters  are  about  the 
same,  surmatioi  areas  will  be  relatively  non-overlapping;  thus  their  individual 
properties  might  be  detectable  by  such  probes.  On  the  other  hand,  the  parafoveal 
core  mosaic  —  with  cone  diameters  of  1.5'  axid  separations  of  2.3  (Kirsch  am 
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Miller,  1987}  —  is  probably  too  fine  for  probing  in  this  way. 

conclusians  are  sunnarized  in  the  following  table. 
TABLE  1 


Ehtity 

Eccentricity 

Diameter 

Separation 

Sum.  Area 

r 

2.9’ 

4.2* 

Cone 

r 

0.8* 

1.1' 

6> 

1.5* 

2.28' 

Initial  tests  m  the  detection  of  small  points  of  t^te  light  were  not 
encouraging,  so  we  devised  a  more  sensitive  test  baised  on  the  obser/ation  that 
the  majority  of  ganglicsx  cells  (the  midget  ganglion  cells,  about  85%)  are 
O]^onent-color-tuned.  Changing  the  task  to  the  discrimination  of  the  color  of 
a  spot  (which  was  one  of  two  opponait  colors),  might  effectively  "thin  out"  the 
mosaic,  since  such  a  spot  would  activate  only  areas  sensitive  to  its  particular 
coloiir 


Our  initial  experiments  were  done  with  very  careful  fixation,  and 
volutinous  data  collection  to  average  out  positional  uncertainty.  The  major 
substantive  conclusion  from  these  studies  was  that  there  was  a  nxinerically  large 
(and  highly  significant)  negative  correlation  between  areas  of  red  and  of  green 
sensitivity.  Blue  vs.  yellow  shows  an  equally  large  effect.  This  clearly  shows 
that  areas  sensitive  to  opponent  colors  ocajq;>y  largely  separate  and  non¬ 
overlapping  retinal  areas.  (Note  that  there  is  no  significant  correlation 
between  areas  sensitive  to  red  and  blue,  or  to  green  and  yellow.)  On  the  other 
haxid,  the  methodological  conclusion  from  these  studies  is  that  the  noise 
resulting  from  uncontrolled  eye  movements  precludes  making  the  kind  of  detailed 
sensitivity  map  we  hope  to  achieve;  a  6x6  array  of  detection  probabilities  (the 
largest  we  found  practical)  hardly  constitutes  a  map.  We  therefore  embarked  on 
the  design  of  an  eye-positiui  monitor.  In  the  *89  report  we  envisicxied  a  video 
system,  which  would  monitor  both  the  pupil  and  the  first  Purkinje  reflection. 
Both  of  these  will  shift  equally  with  head  position,  but  the  Purkinje  reflection 
shifts  somewhat  less  with  rotation  of  the  eye  than  does  the  pupil.  Thus  a 
differential  measurement  should  correlate  with  eye  position. 

1.  Fixation  Error 

The  major  difficulty  in  mapping  such  small  areas  of  the  retina  is,  of 
course,  the  inability  of  a  subject  to  maintain  perfect  fixation.  We  set 
conditions  to  provide  maximal  assistance  to  the  subject:  the  subject  had  a  good 
fixation  target  (a  cross  within  a  square),  ^d  was  allowed  to  trigger  trials  only 
Tdien  he  believed  his  fixation  to  be  very  good.  There  do  not  seem  to  be  data  which 
clearly  test  the  adequacy  of  this  technique.  Estimates  of  fixation  accuracy 
over  relatively  short  intervals  (e.g.  Eizerman  et  al,  1985)  suggest  that  actual 
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fixation  position  varies  between  +/'  10  arc-minutes,  with  a  standard  deviation 
of  about  5-7  arc-miautes.  In  our  paradigm,  fixation  should  be  at  least  this 
good,  but  it  might  be  considerably  better.  Furthermore,  any  study  relying  on 
instninents  to  make  fine  measurements  of  eye  position  are  inevitably  subject  to 
questions  of  calibration,  etc.  We  devised  a  purely  psychophysical  technique  for 
measuring  fixation  error  in  conditions  similar  to  our  experiment.  The  technique 
relies  cm  after-images  and  human  observers'  hyperacuity  at  making  positional 
judgments. 

An  after-image  of  a  short  vertical  line  was  produced  by  looking  into  a 
strobe-light  covered  with  a  mask.  A  fixation  point  appeared  cm  a  crt  screen, 
followed  by  two  vertically  oriented  flanking  lines,  twenty  pixels  apart,  for  a 
duration  of  200  msec.  The  observer's  job  was  to  rate  the  positicm  of  the  after¬ 
image  relative  to  the  flanking  lines.  Control  dataware  also  taken,  substituting 
an  actual  line  in  place  of  the  after-image. 

The  results  for  the  control  data  indicated  that  untrained  subjects  can 
perform  the  task  with  a  standard  error  of  about  .7  arc-minutes.  Since  fixation 
error  is  presumably  several  arc-minutes,  the  positional  judgments  have  more  than 
enough  accuracy  to  measiire  fixation  error. 

Three  experimental  sessions  were  nm  with  observer  DJS.  The  standard 
deviation  of  the  after-image  placement  relative  to  the  flanking  lines  ranged 
between  3.8  and  5.1  minutes.  While  these  data  indicate  that  fixation  accuracy 
is  good  enough  for  many  purposes,  it  may  not  be  accurate  enough  for  mapping  small 
areas  of  the  parafovea  where  receptive  field  sizes  of  ganglion  cells  are  as  small 
as  3  arc-ndnutes  (Derrington  S  Lennie,  1984).  We  decided  that  precise  mappi  g 
required  greater  fixation  accuracy,  and  that  the  best  way  to  achieve  this  was 
with  a  high-precision  eye-monitor. 


2.  Elye-Fositicxi  Hcxiitor 


A  difficulty  in  this  work  is  that  we  have  only  the  crudest  means  of 
estimating  the  true  direction  of  gaze,  to  compare  with  the  predictions  of  our 
eye-position  monitor.  Initially  we  simply  ran  oxur  col  our -discrimination 
experimotts  using  the  eye  position  monitor;  any  improvement  in  the  data  would 
have  reflected  a  reduction  in  eye-positloi  inaccuracy  due  to  the  monitor.  There 
was  no  improvement.  We  therefore  turned  to  more  basic  studies  of  the  mcmitor's 
behavior.  First  we  considered  the  accuracy  of  the  routines  which  localize  the 
pupil  and  the  reflection.  For  our  desired  accuracy  (l'-2'}  it  will  be  necessary 
to  localize  to  about  4  mdcrcrs  or  0.03x  the  size  of  a  pixel.  Our  localization 
algorithrs  are  designed  to  perform  in  the  range  of  hyperacuity,  and  various 
experimmcs  indicate  that  the  routines  are  indeed  accurate  enough. 


a.  Artific.al  Eye  Data 

The  most  direct  experiment  was  done  with  an  artificial  eye  moved  by  a 
micrometer.  An  index  card  was  produced  with  a  black  circle  to  represent  the 
pv^il.  A  white  circle  within  the  black  circle  represented  the  reflection  of  the 
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source  off  the  surface  of  the  cornea  (the  cotaeal  reflux).  The  micrometer 
was  used  to  move  the  artificial  eye  in  0.01  nm  steps.  The  raw  ^ta  are  presented 
in  Figure  2. 


The  most  valid  analysis  of  the  results  is  a  ccnparison  of  the  difference 
between  the  computed  positions  of  the  artificial  pupil  and  reflux,  since  this 
will  be  our  actual  experimental  measure.  The  standard  deviation  of  the 
difference  was  computed  to  be  4  arc-ndnutes,  tduch  we  take  as  a  measure  of  the 
resolution  of  the  eye-monitor  under  ideal  circuistances.  Ultimately  we  would 
like  to  refine  our  algorithms  to  improve  this  accuracy  by  about  2x,  but  presently 
there  are  far  more  important  lindtations  to  be  dealt  with.  Note  that  this 
measurement  equates  to  .058  pixels— demonstrating  that  the  monitor  is  operating 
.11  into  the  hyper-acuity  range. 

b.  Natural  eye  data 

Me  then  proceeded  to  make  measurements  of  large  excursions  of  a  real  eye, 
where  we  could  trust  the  observer's  report  of  fixation.  He  found  that  the 
differential  movement  of  the  comeal  reflection  and  the  pupil  was  simply  not 
great  enough  to  provide  the  needed  accuracy.  Probably  the  situation  would  be 
improved  by  using  higher  Purkinje  images,  as  in  the  Stanford  Eye  Tracker,  but 
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these  are  faint  and  usually  lost  withrn  the  large  first  inage.  Surprisingly,  if 
we  greatly  reduce  the  sise  of  the  first  image,  nuking  t.he  lj.gher  mages  mere 
visible,  then  cur  hyper-acuity  algorithru  lose  their  power  and  accuracy 
declines.  We  decided  instead  to  try  to  control  for  head  motion  directly,  by 
placing  a  srrall,  accurately  resolvable,  target  in' the  canthus  of  the  eye.  Srrr. 
styrofoam  beads  worked  well  for  this.  Fig*.-re  3  shows  a  typical  exa-cple.  (Note 
that  the  mage  processor  splits  the  image,  leaving  out  th4e  unmpertant  part  of 
the  eye  between  the  pupil  and  the  canthus.) 


Figure  3 


A  captured  video  frame  showing  the  pupil  and  comeal  reflux  (on 
right)  and  the  styrofoai.!  ball  (on  left). 


It  is  clear  that  a  carplex  mathenvitical  relation  must  relate  the  observed 
quantities  (primarily  the  centers  of  the  pupil  and  the  bead)  with  direction  of 
gaze.  To  determine  this  relation  a  ptiori  is  probably  not  possible.  In  general, 
the  carr^ra  cannot  observe  the  eye  exactly  along  the  line  of  sight,  so  the  image 
coordinates  are  not  orthogonal  in  the  plane  of  the  eye,  nor  are  they  related  one- 
to-one  to  the  cardinal  directions  of  gaze.  Similarly  there  is  no  practical  way 
to  calculate  the  relation  between  pupil  center  and  direction  of  gaze  (even  with 
head  position  controlled).  Because  the  angles  involved  are  all  very  small, 
however,  we  nu/  assume  that  the  prediction  eqxiation  is  linear.  Thus  allows  uc 
to  use  a  form  of  learning  paradigm,  in  which  the  corputer  constructs  the 
prediction  equation  by  linear  regression  on  a  set  of  known  eye-movements.  In 
practice,  we  supplied  the  subject  with  four  fixation  points  at  the  comers  of  a 
square;  initially  we  used  a  10*  square,  but  found  that  we  requirevi  a  one  de^gree 
square.  The  subject's  eye  position  w.s  recorded  several  tmes  while  fixating 
each  point,  to  produce  a  regression  data  set. 

The  linear  regression  was  much  more  than  a  way  to  determine  an  equation, 
however.  By  detailed  analysis  of  the  individual  correlations,  we  gained 
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figure  4  The  predicted  values  are  the  result  of  a  regression  analysis  based 
on  the  tracker’s  connputed  values  of  pupil  and  reflux  location.  The 
xsiits  are  display-pixels;  about  0.6'  of  visual  angle. 


considerable  insight  into  our  sources  of  error.  For  exanple,  the  observation 
that  trial  nxinber  had  a  high  correlation  with  other  observables  helped  us 
identify  a  drift  problem.  At  this  point,  the  major  obstacle  is  with  the  styrofosn 
bead  as  an  index  of  head  position.  Under  normal  conditions,  the  location  of  the 
bead  has  a  large  standard  error,  and  very  little  correlation  with  anything.  It 
is  readily  observed  that  the  bead  moves  with  eye  blinks;  possibly  it  is  not 
returning  accurately  to  its  initial  position.  This  is  difficult  to  verify,  but 
an  experiment  in  which  the  subject  was  extremely  careful  not  to  blink  or  move  his 
head  yielded  noticeably  better  predictions,  but  the  best  standard  errors  of  the 
estimate  are  still  on  the  order  of  20  -  30  arc-  minutes  (Figure  4).  A  portion 
of  the  standard  error  is  due  to  genuine  fi.xation  error,  but  as  shoim  in  Section 
B.l,  fixation  error  is  probably  well  under  10  arc-minutes,  and  therefore  not  the 
major  component  of  the  tracker's  inaccuracy.  The  position  of  the  bead, 
however,  made  almost  no  contribution  to  the  prediction.  This  all  implies  that 
bead  position  is  too  unreliable  to  use  as  a  control  for  head  movement.  Our 
current  thinking  is  that  a  bead  fastened  to  the  bridge  of  the  nose  may  be  more 
stable.  Unfortunately  this  will  requires  second  video  camera:  before  proceeding 
to  this  expense  we  are  seeking  ways  to  demonstrate  the  viabil  ity  of  this  approach 
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with  our  present  apparatus. 

C.  Chromatic  Summation  Areas 

The  entire  enterprise  of  mapping  the  ganglion  cell  rnasaic  with 
psychophysical  techniques  is  based  on  certain  assumptioirs  that  are  derived 
primarily  frcm  physiological  studies  perfortred  on  macaques.  We  decided  that 
psychophysical  data  would  be  useful  to  supplement  the  physiological  data, 
particularly  as  it  related  to  our  assumption  of  receptive  field  sices.  We 
therefore  enbarked  on  a  study  of  chromatic  sutmation  areas  in  the  periphery 
(anith  &  Swift.  1991). 

All  experiments  were  performed  on  a  CRT.  Red  spots  of  light  were  flashed 
for  200  msec  on  an  equilrcninant  green  background  at  varying  eccentricities.  The 
other  major  independent  variable  was  spot  size.  The  dependent  variable  in  all 
cases  was  chromatic  contrast.  Functional  eguiluminance  was  determined  by 
measuring  detection  thresholds  at  various  red-green  ratios,  and  picking  the  ratio 
that  yielded  the  highest  threshold. 


EQUILUMiNANT  SPOTS 


Spot  OiaiTietsr 

Figure  5  Results  of  Chromatic  Summation  Experiment.  Note  that  Riccc’s  Law 
iitplies  a  zero  slope;  full  summation  implies  slope  =  2;  data  fall 
in-between  (Piper's  Law) 
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If  a  stimulus  is  within  the  receptis^*^  field  of  a  detector,  then  Ricco’s  Law 
should  obtain;  i.e.  there  should  Jv,  a  complete  trade-off  between  area  and 
contrast.  Another  way  of  phrasing  this  is  that  total  «iergy  at  threshold  should 
not  change  as  a  function  O'.  apot  size—yielding  flat  curves.  No  surmation,  on 
the  other  hand,  requires  a  slope  of  two,  since  energy  rises  as  the  square  of  spot 
diameter.  The  data  (Figure  5)  are  clearly  in  between  the  two  extremes.  This 
relationship  has  been  referred  to  as  Piper *s  Law,  although  the  underlying 
mechanism  is  not  well  understood.  Presumably  then,  the  chromatic  summation  areas 
are  l«iSS  than  14  arc-minutes --the  smallest  spot  sizes  the  experiment.  The 
limiting  factor  on  spot  sizevas  not  hardware  resolution;  rather  it  was  detection 
threshold,  which  was  close  to  100%  contrast  for  spot  sizes  of  10  arc-minutes. 
These  results  raise  the  interesting  qxiestion  of  v’hether  the  response  of  a  single 
ganglion  cell  to  a  near  optimal  stimulus  is  sufficient  for  detection. 

A  second  experiment  was  done  with  luninance  spots  in  order  to  compare  the 
results  to  those  with  chromatic  stimuli  (Figxire  6).  Note  that  while  thresholds 
are  lower,  once  again  Ricco's  Law  did  not  obtain. 
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Figure  6 


Results  of  sumnnation  experiment  with  luninance  contrast. 


D.  A  Model  for  Chromatic  Identification 

In  the  course  of  trying  to  map  tl«  retinal  mosaic  it  occurred  to  us  that 
we  were  dealing  with  many  unspoken  assinptions  about  underlying  processes.  It 
struck  us  that  it  would  be  better  sci«ice  to  start  with  a  working  model  of 
chrcxnatic  identification  that  would  explicitly  state  the  assvxrptions  we  were 
working  under,  and  also  allow  us  to  test  the  inplications  of  the  various 
assumpticaas.  In  other  words,  we  could  freely  vary  parameters  in  the  model  to 
test  the  robustness  of  the  assumptions. 


1.  Available  Physiological  Data 

From  such  sources  as  Zrenner  et  ai,  1989,  Derrington  &  Lennie,  1984,  Livingstcai 
&  Hubei,  1987,  and  Perry  &  Cowey,  1985,  we  have  made  the  following  assvxrptia^ 
regarding  the  ganglion  cells  at  7*  in  the  periphery. 

•  about  85%  of  the  ganglion  cells  project  to  parvocellular  layers  in 
the  lateral  geniculate;  the  other  15  %  project  to  the  magnocellular 
layers 

•  over  80%  of  the  parvocellular  cells  are  chranatically  opponent;  the 
magnocellular  cells  are  not  considered  to  be  color-opponent 

•  there  is  considerable  variability  in  the  neutral  point  for  the  80% 
of  the  parvo  cells  that  are  color-opponent 

•  the  majority  of  the  color  opponent  cells  are  red-green  rather  than 
blue-yellow 

•  receptive  field  centers  of  parvo  cells  at  7*  in  the  periphery  are 
about  5  arc-minutes  with  relatively  little  variability 

•  spacing  between  ganglion  cell  centers  is  also  approxinately  5  arc- 
minutes  at  7*  in  the  periphery 


2.  Assumptions  Based  on  Known  Physiology 

The  facts  stated  above,  along  with  other  corrmonly  held  beliefs  lead  to  further 
assumptions  related  to  chromatic  identification.  Sane  of  the  assurptions  are 
fairly  tenuous,  but  this  is  not  a  weakness  of  the  model.  Rather  the  weaker 
assurptions  can  be  identified,  modified  and  e.xamined  in  the  model . 

•  Fed  on-center  and  green  on-center  cells  have  non-overlapping 
receptive  fields.  Since  there  is  close  to  a  one-to-wie 
correspondence  between  cones  and  ganglion  cells  and  since  receptive 
field  sizes  of  gangliax  cells  and  cones  at  7*  in  the  periphery  match 
reasor*ably  well,  it  is  likely  that  on-centers  receive  inputs  from 
only  one  or  two  cones.  Since  cones  don’t  overlap,  neither  should 
ganglion  cell  receptive  fields 
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The  idistvibution  of  ganglion  cell  types  is  catpletely  random.  This 
assurptiorii  is  not  so  nuch  based  on  known  physiology  as  it  is  on  lack 
of  evidence  to  the  contrary.  It  would  re<iuire  some  active  mechanisn 
to  achieve  sane  regularity  in  the  distribution  of  ganglion  cells, 
and  no  such  mechanism  has  ever  been  reported.  Ihis  turns  out  to  be 
a  fairly  inportant  assumption  in  the  model,  and  one  that  will  have 
to  be  carefully  evaluated. 

The  likelihood  of  a  red  response  to  a  spot  of  light  is  determined  by 
the  responses  of  the  red  on~center  ganglion  cells  minus  the 
responses  of  the  green  on-center  ganglion  cells.  This  is  seldon 
stated  explicitly  but  it  follows  from  many  conmaniy  held  beliefs. 
A  more  thorough  analysis  of  signal  and  noise  might  suggest  a  more 
subtle  criterion. 


3.  A  Description  of  the  Model 

There  are  two  stages  in  the  model :  (1)  construction  of  a  representative  ganglion 
cell  mosaic,  and  (2)  sinulation  of  an  experiment  that  presents  small  spots  of 
colored  lights. 

a.  Constructing  a  Representative  Mosaic 


A  Poisson  process  is  first  used  to  place  as  many  ganglion  cells  as  can 
comfortably  fit  into  a  hexagcnal  area  without  overlap.  All  additional  cells  are 
then  added  without  the  requirement  for  non-overlap.  Cells  are  randomly  placed 
according  to  the  following  proportions:  35%  red  on-center,  35%  green,  17.5%  blue, 
17,5%  yellow.  Non-opponent  parvo  cells  and  magno  cells  are  ignored  since  they 
presumably  do  not  contribute  to  chromatic  identification.  The  canister  then 
performs  an  iterative  pushing  algorithm  that  moves  the  additional  cells  around 
to  acltieve  a  reasonable  degree  of  non-overlap.  Although  the  original  area  is 
hexagonal ,  the  final  packing  t\ums  out  to  be  only  crudely  he.xagonal ,  idnich  is 
probably  appropriate  for  ganglion  cells.  A  sample  mosaic  is  presented  in 
Figure  7.  Note  the  clustering  of  red  and  green  on-center  cells.  This,  idule 
slightly  counter-intuitive,  is  solely  a  product  of  random  chsuice. 


b.  Sinulaticn  Results 

The  model  simulates  the  following  experiment:  Sixteen  different  fixation 
positions  are  use,  randomly,  over  the  course  of  the  experiment.  At  each  fixation 
position,  there  are  15  random  presentations  of  a  red  spot  of  light,  and  15  of  a 
green  spot.  The  observer's  job  is  to  respond  red  or  green.  In  a  second 
condition  the  observer  may  respcsnd  red,  green  or  neiutral.  The  simulation 
includes  a  value  for  fixation  error  (See  page  6),  so  that  the  actual  spot  of 
light  is  placed  at  some  random  gaussian  distance  from  the  fixation  point.  The 
respmse  of  the  ganglion  cells  is  determined  by  the  sensitivity  of  a  particular 
type  of  cell  to  the  color  of  the  stinulus  spot  and  by  the  gaussian  distance  of 
the  spot  from  the  receptive  field  center.  The  gaussian  distance  factor  controls 
both  for  the  gaussian  nature  of  receptive  field  centers  and  the  gaussian  nature 
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(Top)  A  sample  array  of  color-opponent  ganglion  cells.  The  white,  green  and  red 
blotches  represent  the  corresponding  incorrect  responses  at  those  fixation  positions. 
(Bottom)  Close-up  of  results. 


of  the  point '‘Spread  function  of  the  optics  of  the  eye.  Gaussian  noise  is  then 
added  to  the  response.  Finally,  if  the  net  result  is  greater  than  0,  the 
appropriate  response  is  given;  othervise  the  incorrect  response  is  given.  In  the 
three-alternative  response  condition,  a  threshold  is  added  to  the  decision  rule. 
If  the  absolute  value  of  the  result  is  below  threshold,  then  the  respcnse  is 
neutral . 

Of  major  concem  in  the  simulation  was  the  question  of  whether  fixation 
error  would  be  too  large  to  allow  for  significant  results.  Fixation  error  was 
therefore  varie  \  parametrically  and  Chi-Square  analyses  were  performeu  to  test 
the  following  K,:  hre  the  relative  numbers  of  red,  green,  and  neutral  respemses 
independent  of  fixation  position.  The  following  table  shows  the  results  of  the 
analysis  for  various  fixation  standard  deviations. 


2-altematives 

3-altematives 

(arc-minutes) 

Typical 

p  value 

4.2 

.001 

.001 

6.3 

.01 

.01 

8.4 

.1 

.01 

10.4 

>.l 

>.l 

12.5 

>.l 

>.l 

14.6 

>.l 

>.l 

It  can  be  readily  seen  that  statistically  significant  results  should  be 
obtainable  with  standard  deviations  for  fixation  error  up  to  8  arc-minutes, 
comfortably  within  the  range  reported  on  page  6.  While  we  have  dbtained 
statistically  significant  results  in  this  experiment  (smith  &  Swift,  1990),  it 
has  not  be«i  as  easy  as  the  above  analysis  would  suggest.  He  suspe^  that  the 
luninance  levels  of  our  CRT  may  not  be  quite  sufficient  for  the  task.  He  have 
purchased  appropriate  equipment  for  using  external  light  sources  under  computer 
control,  and  will  report  on  the  results  of  these  experiments  in  next  year's 
annual  report.  He  are  also  in  the  process  of  conducting  simulations  with  a 
variety  of  assunppticns ,  and  hope  to  achieve  a  more  conplete  match  between  the 
actual  aivd  simulated  data. 


E.  The  VisionHorks  Visual  Stimulus  Generator 

During  the  tenure  of  this  grant,  the  PI  was  also  significantly  involved  in 
the  founding  of  Vision  Research  Graphics,  Inc.,  tdiose  purpose  was  to  develc^ 
state  of  the  art,  corputer-graphics-based  visual  stinulators  for  use  by  vision 
researchers,  and  ultimately  by  the  ophthalnological  comunity.  With  the 
concurrence  of  the  APOSR  program  director,  a  significant  part  of  the  Pi's  time 
under  this  grant  was  devoted  to  the  design  of  VRG's  visual  stimulators.  Although 
it  is  quite  inpossible  to  disentangle  exactly  what  portions  of  this  effort 
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may  have  been  sponsored  by  ftFOSR,  the  results  have  been  iirpressive,  and  certain 
parts  can  be  clearly  pointed  out  as  the  result  of  the  Pi's  efforts.  VRG  has  two 
basic  product- lines,  i)  pcStereoscope  —  a  PC-based  stereoscope  of  modest  cost 
and  wide  applicability,  and  2)  VisionHorks  —  a  major  integrated 
software/hardware  package  which  we  explicitly  intend  to  be  the  finest  visual 
stimulator  available. 


1.  pcStereoscc^ 

The  pcStereoscope (tm)  is  a  low-cost  computer-graphics  stereoscope  which  operates 
on  an  ISl/PC  or  conpatible  computer  with  an  5GA  or  VGA  display.  It  utilizes  a 
pair  of  LCD  shutter-goggles  to  present  alternate  frames  of  the  CRT  display  to 
opposite  eyes.  The  software  maintains  two  distinct  images  of  the  visual  scarce 
in  two  hardware  pages  of  the  EGA:  one  for  each  eye.  This  permits  stereo  viewing 
(«dien  the  pages  are  a  stereo  pair)  as  well  as  haploscopic  viewing  of  any 
arbitrary  sort,  since  the  images  to  the  two  eyes  are  entirely  ind^endent. 
pcStereocsope  is  being  used  as  a  stereo  display  in  about  2  dozen  laboratories 
across  the  world,  and  a  variety  of  studies  have  actually  utilized  it.  He  have 
presented  three  papers  which  used  the  pcStereoscope.  At  least  one  of  these  — 
a  comparison  of  four  distinct  measures  of  the  ability  to  fuse  stereo  images  — 
could  not  have  been  done  with  any  other  apparatx^,  since  the  pcStereoscope  could 
generate  all  four  paradigms  with  identical  luminances,  contrasts,  etc,  and  all 
in  a  single  sitting.  In  an  experimental  setting,  the  pcStereoscope  is  siqpported 
by  its  Software  Developmmt  System.  The  low-level  basics  of  this  graphics 
library  (e.g  drawing  of  points,  lines,  etc.)  were  written  by  the  author,  and  — 
at  the  time  —  were  detezmdned  to  be  the  fastest  available  for  the  EGA. 

The  primary  use  of  the  pcStereoscope,  however,  has  been  in  implementing 
VisionLab(tm)  —  an  upper-level  college  visual  perception  course  built  around 
some  three  dozen  demonstrations,  and  seven  actual  experiments.  The 
demenstrations  include  all  of  the  well-known  vis\ial  demonstrations  and  illusions, 
as  well  as  some  unusual  ones,  and  a  few  tdiich  were  discovered  with  the 
pcStereoscope.  (One  of  the  latter  is  the  demonstration  of  stereopsis  from  pure 
form  (form-frcm-notion,  fonn-frcm-subjective  contours,  etc)  without  any  true 
binocular  cues.  This  was  described  in  detail  in  our  first  Annual  Report.)  Our 
demonstrations  are  unique  among  computerized  visual  demonstration  programs,  in 
that  the  student  can  vary  every  reasonable  parameter  of  the  display.  For 
example,  in  the  Mueller-Lyer  illusion  the  student  can  change  all  the  dimensiois 
of  the  lines,  as  well  as  the  angle  of  the  "arrowsheads" .  Using  our  stereo 
facilities,  the  student  can  place  the  arrowheads  in  a  different  depth  plane  from 
the  shafts,  or  be  can  vary  the  angle  of  the  arrowheads  in  depth,  so  that  they 
resemble  3-d  comers.  Finally  all  of  the  above  can  be  done  with  the  illusion  in 
a  randont-dot  stereogram  form,  all  monocular  cues  being  eliminated. 

The  experiments,  though  fewer  in  nurber  play  an  inportant  role  in  that  1) 
they  show  that  visual  science  is  not  ji^st  clever  demonstrations,  and  2)  they 
actually  provide  a  course  in  psychophysical  methodology.  He  offer  seven 
psychophysical  methods,  frcm  sinple  method-of -adjustment  to  signal  detection 
analysis.  Thus  in  the  Mueller-Lyer  exepriment  (an  elaboration  of  the 
demoratration  described  above)  the  student  can  observe  the  differences  and  trade¬ 
offs  between  sinple  MQA  nulling  of  the  illusion,  versus  forced-choice,  method  of 
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constant  stimuli,  etc.  Having  selected  the  most  appropriate  psychophysical 
method,  he  can  then  measure  the  effects  of  the  various  stimulus  manipulations 
described. 

A  specialized  application  of  the  pcStereoscope  is  Stereo-Snapshot (tm), 
which  was  developed  sitirely  by  the  author.  This  is  a  TSR  which  remains  in  the 
PC  while  the  user  runs  any  program  capable  of  generating  a  stereo  pair  of  images; 
we  are  specifically  targetting  the  3-d  CAD  market,  since  such  programs  can 
produce  a  stereo  pair  by  a  simple  rotation  about  the  vertical  axis.  The  user 
generates  each  member  of  the  stereo  pair,  and  saves  it  to  disk  with  Stereo- 
Snapshot.  Then  a  call  to  Stereo-Snapshot  displays  the  pedr  in  stereo.  Note  that 
there  is  no  alteration  to  the  host  program,  and  being  a  TSR,  Stereo-Snapshot 
operates  without  ever  exiting  the  host.  Thus  Stereo-Snapshot  works  with 
essentially  any  3-d  CAD  or  3-d  studio-type  program. 

2.  VisionHorics(tm) 


Visicnf/orks  is  VRG's  high-level  visual  stimulus  generator.  It  ccxisists  of 
an  integrated  package  of  hardfcrare  and  software  designed  so  that  many  experiments 
can  be  designed  entirely  frcm  a  menu  interface,  while  unusual  experiments  can  be 
produced  with  a  minimum  of  actual  programming.  At  this  point,  such  custom 
programming  is  more  cumplex  than  we  would  like,  and  we  are  working  on  a  more 
automated,  user-friendly  system.  Nonetheless,  the  majority  of  applications  >dd.ch 
we  write  for  customers  are  done  oitirely  from  menu  selections.  (The  only  reason 
we  write  such  simple  applications  is  that  we  include  a  certain  amount  of  custom 
programting  with  each  system;  a  new  customer  generally  doesn't  realize  how  simple 
his  proposed  experinant  is!) 

Viewed  from  low-level  to  high-level,  VisicnAtorJts consists  of  the  hardware 
and  operating  system,  the  software  developmant  environnnent,  and  t^  Visiarifocks 
Manager.  The  operating  system  provides  the  functional  link  tMdh  ties  the 
hardware  together.  The  software  development  environment  is  a  collection  of  tools 
that  allows  the  user  to  efficiently  program  the  hardware.  The  Visionfforks 
Manager  is  code  written  by  VRG  which  streamlines  the  production  and  managemient 
of  vision  experiments.  Each  level  is  dependent  upon  the  previous  one.  However, 
the  converse  is  not  true.  The  software  development  environmKit  can  be  used 
without  the  VisicnWorks  Manager,  and  often  will  be. 

VisianMorks  is  sv;pplied  as  a  base  system  with  optional  modules.  The  base 
system  consists  of  hardware  for  a  standard  (non-stereoscopic)  display  system,  the 
software  development  environmait  (C++  compiler,  TIGk  software  driver,  MenuMaker 
utility  and  the  function  library),  and  the  Visicnfforks  Manager.  The 
Visionfforks  Manager  includes  facilities  for  experiment  data  output  and  for 
naming  preconfigured  experiments  in  a  simplified  manner.  Tlie  latter 
functionality  will  be  referred  to  as  the  Experiment  Manager.  The  StinulusMaker 
and  MethocMaker  (Psychophysics)  Modules  are  optional. 

VisionMorks  modules  are  bodies  of  code  which  are  written  to  ccmventions 
defined  by  a  VisionWorks  standard.  Modules  perform  specific  functions,  such  as 
stimulus  generation,  but  are  written  in  a  manner  which  allows  them  to  be  linked 
together  within  the  framework  of  a  VisionMorks  application.  Modules  written  by 
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VRG  are  large  aiid  extremely  versatile.  Modules  can  also  be  written  by  users,  and 
will  be  smaller  and  more  specialized. 

VisionWorks  applications  are  stand-alone  programs,  generally  experiments, 
that  are  produced  by  users  or  by  VRC.  Applications  will  often  use  modules 
written  by  1^,  such  as  the  StinulusMaker  and  MethodMaker  modules.  A  specific 
application  will  typically  not  make  use  of  all  the  functionality  of  a  VRG  written 
module.  Rather,  the  application  will  incorporate  only  the  features  it  needs  from 
a  module. 

Visior^farkshas  3  color  modes:  normal  RGB,  ganma  RGB,  and  gamra  monochrome. 
Normal  RGB  mode  is  a  standard  color  mode  with  256  color  levels  available  for  each 
color  gun.  GartmaJlGB  mode  is  a  gamma-corrected  color  mode  in  which  a  user  will 
specify  a  color  value  within  a  range  of  0-255  and  the  output  from  the  color  gun 
will  be  the  closest  value  to  linear  within  that  range. 


Ganma  monochronre  is  a  special  mode  which  operates  only  with  a  monochrcme 
monitor  and  a  VRG  grey-scale  expander.  The  grey-scale  expander  takes  the  output 
of  the  three  color-OACs  and  adds  them  with  different  weights,  so  that  the  red  DAC 
si;$plies  the  course  luninance,  while  the  green  and  blue  DACs  are  progressively 
finer  adjustments.  While  such  a  system  has  been  used  before,  it  is  subject  to 
the  major  problem  that  DACS  are  typically  not  acoirate  to  much  better  than  their 
smallest  step.  Thus  while  it  might  seem  that  three  8-bit  DACs,  suitably 
weighted,  would  provide  24  bit  resolution,  the  actual  acauracy  is  only  9  or  10 
bits.  We  have  circupnvented  this  problem  by  actually  measuring  the  output  of  each 
DAC  step  to  15  bits  accuracy.  A  computer  program  produces  from  these  data  a 
32k*3byte  look-\^>  table  which  takes  a  15  bit  brightness  value  and  returns  3  bytes 
to  be  sent  to  the  3  DACs.  Mcnotcnicity  is  guaranteed  to  15  bits,  though  we  are 
able  to  measure  actual  luninance  linearity  to  only  13  bits  for  practical  reasons. 
13  bits  linearity  seems  accurate  enough  for  any  purpose,  however.  To  achieve 
this,  it  is  necessary  to  compensate  for  the  considerable  luninance  non-linearity 
in  the  CRT  phosphors.  This  is  accomplished  with  the  VRG  Photometric 
Linearizatioi  System.  This  is  a  hlgh-precisioi\  photometer  (designed  by  the 
author)  cox^led  to  a  major  program  which  controls  the  entire  calibration 
procedure.  With  only  minor  operator  intervention,  this  system  accomplishes  all 
of  the  calibrations  described  above  in  about  1/2  hour;  done  by  hand  these  would 
require  a  full  day.  All  new  systems  are  calibrated  before  being  shipped;  in 
addition  the  Calibration  System  is  available  as  an  option  to  experimenters 
requiring  highly  reliable  calibration. 

The  two  most  important  parts  of  the  VisionNorks  software  are  StinulusMaker 
and  MethodMaker .  StinulusMaker  is  a  menu-driven  stimulus-producer,  which  frees 
the  experimenter  from  having  to  program  any  of  the  ccmnonly-used  visual  stimuli. 
A  complete  descripticm  of  this  module  (which  represents  about  a  nan-year’s 
effort)  is  beyond  the  scope  of  this  docunent;  Appendix  1  presents  a  simple  list 
(running  to  7  pages!)  of  the  menu  options.  MethodMaker  is  an  elaboration  of  the 
idea  of  making  the  psychophysical  methods  interchangeable  which  was  introduced 
in  VisionLab.  This  curr^tly  makes  about  10  psychophysical  methods  available  to 
the  investigator,  including  such  complex  techniques  as  the  Q^JEST  staircase  axvi 
a  full  signal -detection  analysis.  Freedom  from  having  to  program  these  into  each 
experiment  is,  we  believe,  a  major  time-saver  for  the  researcher  who  wishes  to 
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concentrate  on  research,  rather  than  tecteiology. 

Since  its  formal  introduction  eight  months  ago,  VisianKorks  has  been  a 
notable  success.  There  are  now  16  systems  in  the  field,  at  prices  ranging  from 
$16,000  to  $40,000.  Considering  that  obtaiiiing  funds  for  such  a  large  purchse 
typically  takes  almost  a  year,  we  thiiJc  this  very  encouraging.  We  hope  that  in 
a  few  months,  with  the  expiration  of  the  first  "grant  cycle",  we  will  se  a 
considerable  increase  in  orders. 
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APPEZODIX  1  Stiinil\]^taker(tm)  Functionality 


It  is  not  possible  to  explain  the  full  functionality  of  Stimul usMaker  in 
a  docunent  of  this  size.  The  following  is  a  simple  list  of  the  options  on  the 
various  Stimul  usMaker  menus,  with  scsne  minimal  ccmnentary.  This  provides  at 
least  a  suggestion  of  the  level  of  functionality  afforded.  All  stimuli  are 
considered  to  be  objects  and  as  such  share  a  camon  set  of  specifications. 
Specifications  involving  visual  angle  are  based  on  the  standard  screen  size  of 
28  by  21  cm,  the  standard  mode  of  1024  by  512  pixels,  and  the  standard  viewing 
distance  of  75  cm.  Additional  specifications  for  each  type  of  stimulus  are 
listed  in  the  following  sections. 

Feature  Specification 


Color  Mode 


Standard  RGB,  Garma- corrected  RGB,  Ganna-corrected 
Maiochrome 


Standard  RGB 
GanmaJlGB 

Monochrare 

Type  of  Object 
Type  of  Patch 

Type  of  Pom 
Eye 

Disparity 

Number  of  Objects 

Size  {Patch  only) 
Horizontal 


256  intensity  values  for  each  color  gun 

User  specifies  intensity  value  for  each  gun  from  0  to 
255,  display  shows  the  linearized  value  that 
Stiiml usMaker  actually  uses 

User  specifies  intensity  from  0  to  32757  (15  bits). 
Stimul  usMaker  provides  a  unique  linearized  intensity  for 
each  specified  value 

Patches  and  Forms 

Gratings,  DOGs,  Derivatives  of  Gaussians,  Random-Dot 
Stereograms,  checker-boards,  rotating  vanes  (see 
Sections  below  for  more  details). 

dots,  circles,  lines,  rectangles,  spheroids  (see 
Sections  below  for  more  details) 

Left,  right,  both  (Use  this  feature  for  dichoptic 
presentation) 

-255  -  +255  pi.xels.  Each  pixel  is  1.2  arc-minutes. 
(However  see  sub-pixel  disparity  resolution  feature  in 
Section  d.) 

1  -  100  (This  is  a  fairly  arbitrary  value;  can  be 
increased  if  required) 

User  specifies  rectangular  acea  in  terms  of  pixels 

1  -  1024  pixels  in  standard  mode;  each  pixel  is  1.2  arc- 
minutes 
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4 


Vertical 


1  “  512  pixels  in  standard  mode;  each  pixel  is  1.9  arc 
minutes 


Position 


Spatial  Window 
{Patch  only) 


Contrast  Mode 


Same.as 


Constant 

Windowed 

Flicker 

Frequency 

U  a  e  r  ’ 
specified 

duration  Mode 

Nupber  of  LUT 
slots 

Tone  Sijna.l 


Center  of  patch  can  be  at  any  pixel  location, 
ccnstrainel  only  by  site  of  patch 

riane.  Vertical  only.  Her i rental  only,  both.  User 
specifies  standard  deviation  of  Gaussian  in  decrees 
(floating  point).  Certain  stimuli  (e.g.  randar.-det 
stereograms,  gratings  moved  with  palette  tricks)  can  not 
be  spatially  windowed. 

Same_as,  Constant,  Windowed,  Flicker,  User-specified 

Any  object  can  share  the  same  Contrast  profile  as 
another  within  the  same  temporal  interval .  Aside  from 
the  added  convenitmee  of  having  to  specify  only  one 
contrast  profile,  this  feature  allows  efficient  use  of 
the  available  LUT  slots,  since  the  same  LUT  slots  will 
be  used  by  both  objects. 

Contrast  is  determined  by  the  specified  peak  and  trough 
brightness  values  aivi  any  additional  contrast  settings 
that  can  be  speciiied  on  the  stimulus  menus 

Gaussian  (User  specifies  peak  and  standard  deviation  in 
frames) 

Linear  (Rise  and  Fall  onset  and  offset  specified  in 
frames) 

Square-wave  on-off.  Square-wave  counter-phase,  Half- 
( rectified)  sine-wave,  counterphase  sine-wave,  raised 
cosine.  The  user  can  specify  duty  cycle  and  starting 
phase. 


Specified  in  cycles  per  second.  This  is  a  floating 
point  value. 

User  creates  an  ASCII  file  of  contrast  values;  if  length 
of  file  is  less  than  duration  of  interval,  values  will 
repeat  cyclically 

Fixed  (User  specifies  nntiber  of  framas) 

Until  response  (Key-press  terminates  stimulus). 

0  -  255.  The  total  nunber  of  LUT  slcts  used  by  all 
objects  within  a  temporal  interval  can  not  exce^  255 
(but  see  same^as  feature  above) 

A  tone  con  be  sounded  coincident  with  visual  stimulus 
onset.  Duration  is  specified  in  nimber  of  f ramies,  and 
frequency  can  vary  from  1  to  14,000  H;. 
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Trigger  Pulse 

a.  Specifications 

Feature 

Types 

ff  of  cctrponer.ts 
Spatial  freq-aency 

Phase 

Angle 

Contrast 

Velocity 

Moticn  rathcds 
Slits 

$  of  Phases 


A  trigger  pulse  can  be  put  out  the  parallel  port 
coincident  with  stimulus  onset.  Polarity,  chaiuiel, 
duration  (in  frames),  and  type  (single  or  continuous 
pulse)  are  specifiable.  A  pulse  can  be  initiated  during 
any  specified  portion  of  an  object.  Pulses  can  also  be 
initiated  synchronously  with  flickering  stimuli  at  any 
phase  of  the  flicker.  A  secondary  pulse  can  also 
specified  with  flickering  stimuli. 


for  Gratings 


Specification 

Normal  (i.e.  linear,  varying  in  one  dimension)  and 
Circularly  Synmetric 

1  ■*  99.  Hardware  will  impose  additional  constraints  if 
components  have  non-zero  velocities. 

.01  to  999  cpd  (real  ripper  limit  depends  on  screen  size 
and  viewing  distance:  '12  cpd  for  a  vertical  grating 
under  standard  conditiors) 

fraction  of  carpi ete  cycle  from  0  to  1,  vdrere  0  {and  1) 
represent  sine  phase  starting  at  left  of  patch 

-90  -  +90  degrees 

0-1 

-99  -  +99  deg/sec.  With  standard  frame  rate  of  120  Hz, 
real  upper  maximun  is  Nyquist  limit  of  60  cycles/second. 

Blits,  Palette  Trick 

pre-corputes  specified  nranber  of  phases  and  blits  them 
in  at  appropriate  interval.  The  ipper  limit  on  patch 
size  is  about  69,000  pixels  (about  10  by  10  degrees) 
updated  every  frame  (138,000  updated  every  2  frames, 
etc.)  for  a  grating  with  one  moving  component.  The 
limit  reduces  by  a  factor  of  2  for  each  additional 
moving  component. 

1  to  999.  Real  upper  limit  depends  m  available  D-RAM 
(memory).  It  is  alx'ut  25  for  maximurs-size  patch. 
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2. 


trick 


Palette 


Epsilon 


Minirdre 


achieved  by  writing  stimulus  to  the  look-up  table  (LOT), 
and  writing  a  sawtooth  to  the  screen.  There  are  no  size 
limitations.  However  the  use  of  palette  tricks  is 
restricted  to  corponents  that  share  the  same  orientation 
and  velocity.  Furthermore,  no  spatial  window  is 
permitted. 

0  to  1.  Maximum  allowed  error  (proportion)  between 
intended  and  actual  spatial  fre<iuericy.  Basic  limitation 
is  that  a  complete  cycle  of  the  grating  must  be 
completed  in  an  integral  nimber  of  pixels. 

With  pal e'.te  trick  motion,  the  user  can  choose  either  to 
minimize  the  difference  between  the  actual  amid  specified 
spatial  frequency,  or  to  minimize  the  nimber  of  lut 
slots  while  still  not  exceeding  epsilcn. 


b.  Specifications  for  Differences  of  Gaussians  (DOGs) 


Feature 

Specification 

Dimensions 

one  or  two  (radially  symmetric) 

Sigma 

0  to  999  degrees 

Space  Constant 

Ratio 

.01  to  999 

Phase 

Standard  or  reversed 

Angle 

-90  to  +90  degrees 

Contrast 

0  to  1 

Contrast  ratio 

0  to  9  (the  user  can  explicitly  set  the  relative 
contrasts  of  the  two  gaussians) 

Maintain  equal 

area 

StdimJusMaker  allows  an  option  to  autonatically  set  the 
contrast  ratio  to  maintain  equal  area  above  and  below 
the  zero-crossings . 

c.  Specifications  for  Derivatives  of  Gaussians  (DRGs) 


Feature  Specification 

Derivative  0  to  99 
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Peak  f  regency 
Phase 
Angle 
Contrast 


.01  to  993 

Standard  or  reversed 
-90  to  +9C  degrees 
0  to  1 


d.  Specifications  for  Randont-Dot  Stereograns 


Feature 

Shape 

Mode 

Static 

Dynamic 

Partial 

Dot  Density 

Dot  Size 


Specification 

rectangular  for  both  background  and  center  area 

static,  dynamic  or  partial 

Basic  irode  that  permits  sub-pixel  disparities 

Randan  eleirents  are  modified  every  lut  update  (can  be 
every  frame  if  desired) 

(-100  to  +100)  user  specifies  the  degree  of  correlation 
tetween  points  in  the  center  rectangles. 

0  to  1  (default  is  .5).  refers  to  proportion  area 
covered  by  the  raivdon  element  that  is  assigned  to  the 
crest  color 

any  nurber  of  pixels  for  both  X  rnd  Y;  mininun  size  is 
1.2  X  1.9  arc-minutes  under  standard  conditions 


Center  rectangle  Size:  limited  only  by  size  of  patch 

Locaticn:  anywhere  within  patch,  constrained  by 

whole-pixel  boundary  and  size 
Disparity:  resolution  is  1.2  arc-minutes  in  standard 
mode;  0.28  arc-seconds  in  sub-pixel  mode 
with  static  gratings 


e.  Specifications  for  Checker-board  Pattern 


Feature 

Specification 

Width 

square 

of 

inner 

1  to  1024  pixels 

Height 

square 

of 

inner 

1  to  512  pixels 

26 


£.  SJpecifications  for  Rotating  Vanes 


Feature 
9  of  vanes 
Type 

Percent  Blur  of 
edges 

Inner  radius 
Outer  radius 
Cycles/sac 

g.  Specifications 

Feature 

Anti-aliasing 

h.  Specifications 

Feature 

Anti-aliasing 

Radius 

i .  Specifications 

Feature 

Anti-aliasing 


Specification 


1  to  99 


Solid  or  Sinusoidal 


0  to  10C% 


1  pixel  tnininiun  to  outer  radius  maxinur. 
Miniitun:  inner  radius;  Maximum:  512  y  pixels 
-66  to  66  (aliasing  occurs  at  around  20  cps) 


for  Dot 


Specification 

disabled  or  enabled  (anti-aliasing  allows  placement  of 
spot  on  a  fractional  pixel  position) 


for  Circle 


Specification 

disabled  or  enabled  (anti-aliasing  allows  placement  of 
circle  on  a  fractional  pixel  position  and  fractional 
radius) 

1  to  256  y-pixels 


for  Line 


Specification 

disabled  or  enabled  (anti-aliasing  allows  placemait  of 


line  on  a  fractional  pircel  position  and  fractional 
length) 

Length  full  screen,  restricted  only  by  location 

j.  Specifications  for  Rectangle 

Featxire  Specification 

Anti-aliasing  disabled  or  enabled  (anti-aliasing  allows  placem^t  of 

rectangle  on  a  fractional  pixel  positicn  and  fractional 
size) 

Length  full  screen,  restricted  oily  hy  locatia. 

Height  full  screen,  restricted  oily  by  location 

Angle  -90*  to  90* 

k.  Specifications  for  Spheroid 

Feature  Specification 

Types  (a)  Raised  Cosines  and  (b)  Circularly  Symnetric 

Gaussians 

Radius  can  be  specified  in  degrees,  rnn,  or  pixels,  but  can  not 

be  less  than  2  y-pixels  nor  greater  than  256  y-pixels. 
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APPENDIX  2.  VisianNorks(tm)  Infonration 


The  following  are  a  sani>le  of  infonrational  flyers  concerning  VisiorWorks 
and  its  cosrpon^t  subsystene.  While  scarcely  corplete,  these  offer  some 
indication  of  the  scope  of  the  system. 


VISION  RESEARCH  ORAPHICS.  Ine. 


VislonWorks^ 

A  high  performance  80466  PC-based  stereoscopic  computer  grai^ics  display  system, 
stimulus  generator  and  experiment  controller  designed  lor  vision  research.  Modular 
software  design  allows  integration  of  user  written  code  and  utility  modules. 

POWERFUL  HARDWARE 

•Binocular,  monocular,  dichoptic  and  stereo  display  formats  using  a  Tl  TMS34020 
graphics  controller 
•120  Hz  frame-rate 

•RGB  monitor  with  256  colors  out  of  a  palette  of  16.7  million  (Sbits/color  gun) 
•Special  RGB  to  monochrome  adapter  that  gives  15  bits  of  brightness  resolution 
in  monochrome 
•Built-in  gamma  correction 

•Stereo  images  presented  at  120  Hz.  wHh  alternating  left-  and  right-eye  bnages. 

yield  a  flicker-free  60  Hz  frame-rate  to  each  eye. 

•Trial  frames  may  be  worn  under  the  goggles 
•Master  or  slave  interface  to  exte.nai  devices 

•Extremely  high  bit-image  transfer  rates  and  full  double-buffering  (4  display 
buffers  plus  scratchpad  image  memory)  allow  smooth  flicker-free  stereo 
animation  at  1024  x  512  pixel  resolution. 

•Separate  monitors  for  operator's  console  and  graphics  display 
•Trackball  for  graphical  input  with  an  additional  potentiometer  for  die  Z  axis 
•^486  (33MHz)  cache  computer  with  100  MByte  hard-drive  and  coprocessor 

UTILITY  MODULES 

UNIQUE  STIMULUS  GENERATION 

•Hierarchical  menu-driven  intelligent  system  which 

•  allocates  and  optimizes  internal  resources 

•  disallows  illegal  stimulus  configurations 

•  sets  parameter  values  automatically  with  complete  over-ride  capability 
•Two-dimensional  Gaussian  spatial  window 

•Many  types  of  flicker 

•Linear,  Gaussian  or  user-input  temporal  window 
•Powerful  pre-defined  stimulus  selection,  including 

•  simple  forms  (bars,  circles,  etc.) 

•  gratings  with  any  number  of  components:  each  component  with  any  spatial 
frequency,  orientation,  contrast,  velocity,  or  phase 

•  derivatives  of  Gaussian  and  differences  of  Gaussian 

•  Random  Dot  Stereograms  (ROS):  static,  dynamic,  partially  correlated 

•New  ROS  mode  yields  disparity  resolution  exceeding  1  arc-second  at  norma) 
viewing  distances 

•Sequencer  ailovt^  multiple  stimuli  to  be  present  at  one  time 


Vision  Research  Graphics,  Inc. 

99  Madbury  Rd  -  Durham,  NH  03824 
(603)868-2270  -  FAX  (603)868-1352 


The  VisionWorks’^'^*  Photometric  Linearization  System 


The  VisionWorks  Lincarizaiion  System  builds  the  system  lookup  tables  that  compensate  for  non- 
linearities  in  the  color  output  DACs  and  (most  importantly)  in  the  monitor.  Monitors  have  built- 
in  "gamma-correction"  which  produces  a  non-linear  output  that  compensates  for  the  compressive 
non-lincar  brightness  response  of  the  human  visual  system.  Since  vision  scientists  wish  to 
specify  luminance  in  linear  units,  VisionWorks  allows  the  user/programmer  to  specify  output 
brightness  in  linear  steps  between  0  and  the  maximum  luminance  that  the  system  has  been 
calibrated  to  produce.  In  gamma-rgb  mode  there  are  256  steps,  in  gamma-monochrome  mode 
there  are  32,768.  Although  each  VisionWorks  system  is  individually  calibrated  before  being 
shipped,  users  who  have  critical  requirements  for  accurate  stimulus  contrast,  or  who  use  different 
display  formats  or  brightness  may  wish  to  be  able  to  recalibrate  systems  themselves. 
Linearization  cannot  be  pciformed  using  a  .^utndard  photometer,  although  linearity  may  be 
checked  with  such  equipment.  The  Linearization  system  works  ONLY  with  VisionWorks 
systems. 

The  Linearization  System  is  comprised  of  both  hardware  and  software.  The  hardware  includes 
a  12  bit  A/D  which  fits  inside  your  VisionWorks  PC.  a  power  supply  and  amplifiers,  and  a 
photodctector  head  containing  a  silicon  photodiode  and  photometric  filter.  The  amplifiers  remain 
connected  to  the  R.  G  and  B  channels  and  to  the  output  of  the  grayscale  expander  at  all  times. 
The  software  is  entirely  menu  driven  and  includes  a  variety  of  procedures,  all  simple  to  perform. 
These  allow  1)  setting  the  monitor's  luminance  range  2)  building  the  gamma  correction  tables 
3)  checking  linearity  resulting  from  the  tables,  4)  measuring  white  field  uniformity,  and  S) 
measuring  monitor  stability. 

The  Linearization  System  worits  by  measuring  the  output  voltages  of  each  DAC  bit.  and  then 
measuring  the  precise  voltagc/brightncss  response  of  the  monitor.  This  relationship  is  measured 
over  256  points  in  for  each  color  channel  and  in  the  monochrome  mode,  which  uses  the  grayscale 
expander.  In  monochrome  mode,  an  interpolative  smoothing  algorithm  i.s  used  to  produce  a 
smooth  curve  of  32768  luminance  values  between  the  measured  data  points.  Each  luminance 
value  results  from  a  voltage.  A  search  algorithm  establishes  the  closest  voltages  which  tlie 
DAC/grayscale  expander  can  produce  for  each  of  the  32,768  table  entries.  The  R,  G,  B  values 
which  produce  linear  luminance  steps  are  then  built  into  lookup  tables,  which  are  loaded  into 
GSP  memory  when  the  system  is  bo«)ied. 

The  Linearization  system  may  be  used  to  perform  major  or  minor  calibrations.  A  major 
calibration  tests  all  components,  including  each  RAMDAC  bit,  and  takes  about  30  minutes. 
Minor  calibrations  may  test  only  a  single  component  (such  as  the  monitor)  and  need  not  actually 
rebuild  the  lookup  tables.  A  typical  calibration  check  will  take  less  than  5  minutes. 

The  Linearization  system  is  recommended  for  a  variety  of  situations.  These  include;  1)  when 
the  monitor  will  be  heavily  used  (causing  phosphor  changes),  2)  when  very  accurate  contrasts  arc 
required,  and  3)  when  the  user  wishes  to  change  the  monitor  image  size  or  brightness  settings. 


The  T^onWorks'^  Experixaent  Workstation 
developed  and  eold  by  l^on  Reaearch  Graphica,  Inc. 


Whatla^^onWorka? 

VisionWorks  is  a  PC-based,  stereo-capable,  computer  graphics  system 
specialized  for  use  as  a  visual  stimulator  and  experiment  controller. 
VisionWorks  is  the  first  display  system  which  allows  a  vision  researcher  to 
integrate  menu-driven  stimulus  generation  and  psychophysical  methods. 
This  can  be  done  with  great  flexibility,  allowing  creation  of  an  unlimited 
number  of  new  and  unique  experiments,  with  minimal  programming. 

VisionWorks  Components 

VisionWorks  is  sold  as  a  base  system  with  hardware  and  software  options 
that  are  priced  separate^. 

Hardware 

The  base  system  hardware  consists  principally  of  a  high-end  PC  and  a 
modified  high-resolution  graphics  controller  and  monitor.  The  base  system 
has  features  indispensable  to  vision  researchers,  including  a  120Hz  frame- 
rate.  15-blt  gray-scale  resolution,  and  careful  photometric  calibration. 

VRG's  optional  stereo  driver  board  and  shutter  glasses  give  the  system 
stereoscopic  capability. 


VisionWorks'^ 

Hardware 


Software 

The  base  system  provides  a  complete  software  development  environment, 
which  includes  extensive  function  libraries,  tools,  and  uUUties  useful  to 
vision  researchers.  VlsionWorks*  software  organization  is  presented  below. 


Modules  may  be  written  by  a  user  or  purchased  from  Vision  Research 
Graphics  (VRG).  Modules  currently  available  from  VRG  are  SttmulusMaker,  a 
display  module  which  provides  preprogrammed  stimuli  and  MethodMaker,  a 
control  module  which  provides  psychoph)rsical  methods.  The  VRG  modules 
are  large  and  powerful;  a  user  would  t^ically  write  small,  special-purpose 
modules  to  perform  tasks  that  the  VRG  modules  do  not  provide. 


SdnwbisMcJcer™  and  MethodMakef^ 

The  StimulusMaker  and  MethodMaker  modules  use  menus  to  allow  the  user 
to  set  up  and  view  stimuli  and  psychophysical  methods.  However,  some 
pro^ammlng  is  needed  to  Integrate  these  modules  with  the  VlslonWorks 
Manager  and  to  allow  MethodMaker  to  manipulate  variables  used  by 
StimulusMaker.  Applications  diat  use  these  modules  can  be  created  with 
relatively  small  amounts  of  additional  code,  much  of  which  can  be  copied 
from  our  examples.  The  code  will  comprise  the  User  Module. 

Purchase  of  both  StlmuIusMokerand  MethodMaker  includes  6  hours  of 
custom  programming  by  VRG.  typically  enough  to  produce  a  simple  working 
application  and  provide  a  good  starting  point  for  creating  related 
e^rlments.  Please  see  the  next  page  for  VRG's  custom  programming 
policies. 


What  can  you  do  with  VlslonWorks? 

VlslonWorks  provides  an  extremely  flexible  platform  for  developing  and 
running  experiments  as  a  stand-alone  psychophysical  workstation,  or  In 
conjunction  with  external  equipment  for  electrophysiology.  The 
StimulusMaker  and  MethodMaker  modules  allow  rapid  development  of 
experiments  requiring  spatially  and  temporally  modulated  stimuli,  random 
dot  stereograms,  and  standard  psychophysical  methods. 

Stereoscopic  capability  makes  VlslonWorks  Ideal  for  Investigating  and 
simulating  strabismus  and  amblyopia,  or  developing  clinical  screening 
procedures.  Used  with  a  large  monitor,  VlslonWorks  is  highly  suitable  for 
developing  advanced  perimet^  techniques  which  use  chromatic  and 
spatiaUy  and  temporally  modulated  stimuli.  Anti-aliasing  techniques  create 
effective  sub-pixel  resolution  for  vernier  acuity  and  stereograms. 


Examples  of  Possible  VlslonWorks  Applications 

^Electrophystologlcal  and  psychophysical  investigation  and  simulation 
of  vision  deflclts  In  strabismus  and  amblyopia. 
^Electrophyslological  and  psychophysical  response  to  spatio-temporal 
and  novel  stimuli  for  investl^'^tlon  of  visual  Held  deficits. 

*  Sophisticated  automated  vision  testing  using  spatial  and  RDS  stimuli. 

*  Comparisons  of  stimuli  generated  using  luminance  and  chromatic 

contrast. 

•Visual  Field  (scotoma)  mapping  using  varying  spatio-temporal  target 
and  background  parameters. 
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VlaionWorki  Custom  Programming  Policies 

If  you  purchase  VlsionWorks  directly  from  VRG,  with  both  the 
StlmulusMaker  and  MethodMaker  modules,  you  are  entitled  to  8  hours  of 
free  programming.  This  amount  of  time  is  enough  to  produce  a  simple 
VlsionWorks  application  which  uses  a  subset  of  the  stimuli  available  in 
StlmulusMaker.  and  a  subset  of  the  psychophysical  methods  available  in 
MethodMaker.  The  principal  purpose  of  dbls  simple  application  is  to 
provide  a  programming  example  upon  which  you  can  model  your  own  code. 


Your  free  application  should  not  require  any  changes  in  the  VlsionWorks 
base  system.  StlmulusMaker.  or  MethodMaker.  unless  the  changes  are 
already  planned.  If  your  program  requires  planned  base  system  changes, 
there  will  be  no  additional  charge  but  the  completion  date  for  the  program 
can  not  be  guaranteed.  If  the  program  requires  changes  in  the  base  system 
which  were  not  planned.  VRG  will  provide  the  programming  at  a  negotiated 
price  and  schedule. 


If  the  specifications  for  your  program  have  been  received  and  approved  by 
VRG  by  the  time  the  PO  is  placed,  the  program  will  be  shipped  with  the 
VlsionWorlK  system.  If  the  specifications  arc  provided  after  receipt  of  the 
PO.  the  system  may  be  shipped  without  the  program.  Payment  for  the 
^stem  is  due  30  days  after  shipment,  irrespective  of  inclusion  of  the 
application  program. 


VRG  will  supply  custom  programming  on  an  hourty  or  on  a  contractual  basis. 
The ‘hourly  rate  is  $75/hr.  and  there  is  an  eight-hour  minimum  for 
contracted  Jobs.  Payment  for  custom  programming  is  due  as  follows:  50% 
upon  receipt  of  PO.  the  remainder  payable  on  a  mutually-agreed-upon 
schedule. 
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APPENDIX  3.  pcStereoscope(tm)  Infomation 


The  following  pages  contain  a  sairple  of  informational  flyers  concerning 
pcStereoscope.  These  offer  further  insight  into  to  scope  and  usefulness  of  this 
project. 


pcSTEREOSCOPE™ 

Software  Development  System 


A  programming  environment  specialized  for  stereoscopic  3-D 


The  pcSTEREOSCOPE  Software  Development  System  speeds  development  of 
stereoscopic  3-D  programs  by  providing  high-speed  graphics  functions,  animation  and 
menuing. 


Stereoscopic  graphics  applications  include: 

•  Vision  Research 

•  Presentation  of  muttidimensionat  data 

•  Scientific  visualization  and  biomedical 
imaging 


•  Fractals 

•  Geologic  imaging 

•  Games 

•  CAD/CAM 


The  Development  System  tndudee  the  following 
categories  of  routines: 


r 


Vision  Research  Applications 


Random-Dot  Stertogram 
Angle  Conversion 
Angle,  Speed,  end  Motion 
BitBLT 
Sprite 

Qeometric  Prtmittvei, 
Including  arc,  line,  cip, 
flHtdpoVgon 

Hercules  Monitor  (provides 
separate  monitors  lor 
text  and  graphics) 

Math 

Palette 


Screen  ConverUon 

Stereo 

Text 

Time  Conversion 
Track  Ball 

Ur«r«fs; 

Browse  Module 
Menu  Module 
Object  Coloring  Module 
Story  Module  for 
animationrimage 
sequencing 


The  Software  Development  System  allows 
the  vision  rcsearJtcr  to  develop  his/her 
own  experiments  and  demonstratioixs. 
Random  dot  stereograms  are  extensivriy 
supported  in  the  system.  Applications  for 
vision  rcseardt  include: 


•  ttareoscopicanddichopticiausions 

•  moving  wire  frame  tiguras.  with  or 
without  sterso  or  perspective  cues 

•  aftereffect  experiments  (color,  motion, 
grating) 

•  static,  dynamic  and  moving  texture 
patterns  and  random  dot  stereograms 


Software  Development  System 

Requires  pcSTEREOSCOPE  Hardware  and  Borland  Turbo  C  Venion  2.0.  Includes  C  Source  Code 
examples,  User's  Manual,  and  Programmers'  Reference  Manual. 

Cost  $350 


pcSTEREOSCOPE  Hardware 

An  inexpensive  stereoscopic  3>D  system  for  EGA  or  VGA  equipped  IBM  PCs  or  oompatibles. 

The  pcSTEREOSCOPE  time>multiplexes  left-eye  and  right-eye  images,  yielding  a  30  Hz  frame 
rate  at  each  eye  to  provide  color  640  x  350  pixel  images. 

The  hardware  package  consists  of  a  single  short-slot  card,  one  pair  of  liquid-crystal  shutter 
glasses  and  a  connector.  A  trackball  with  an  additional  potentiometer  for  d\e  z  axis  is  available 
as  an  optional  3D  input  device. 

Cost  $450 

Additional  Shutter  Glasses  $7S/pair 
TrackbaUSlSO 


Recommended  System  Configuration: 

12  MHz  PC  AT  compatible  or  better,  with  hard  drive,  1  MB  minimum  memory,  and  VGA 
graphia. 
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pcSTEREOSCOPE  Software  Development  System 
Technical  Description 

Ilte  pcSTEREOSCOPE  Software  Development  System  (PCSDS)  is  a  C*Unguage  based 
development  environment  for  the  Vision  Research  Graphics,  inc. -pcSTEREOSCOPE  baidware. 
The  P^DS  consists  of  libraries  which  provide: 

1.  drivers  for  the  hardware. 

2.  very  fast  gr^ihics  primitives, 

3.  advanced  graphics  operations, 

4.  scquettting/animadoQ  roatines, 

5.  a  menu^onns  input  system, 

6.  a  Inowse/help  u^ty. 

Hie  PCSDS  is  intended  for  use  with  Borland  Turbo  C  2.0.  Extensive  documentation  and 
application  source  code  examples  are  provided.  An  optional  driver  developnoent  Idt  contains 
driver  source  code  suitable  for  incoiporadon  into  existing  programs.  Any  C  cmnpiler  can  be  used 
for  driver  development 

Converting  Application  Programs  to  Stereo 

The  PCSDS  is  suittble  fdt  bodi  programming  ‘from  scratch*  or  for  converting  existing  *3>D'' 
programs  u>  stereo.  Converting  programs  which  generate  stadc  images  (such  as  CAD  programs) 
is  generally  simple.  The  pcogcun'$  existing  routines  are  used  to  place  left-eye  and  ri^t-eye 
images  into  two  display  pages.  The  pcSTEREOSCOPE  driver  is  then  called,  which  turns  on  the 
shutter  glasses  and  flips  the  ^splay  pages. 

Disjday  Formats  .* 

The  PCSDS  piinciply  supports  IBM  mode  lOH,  which  is  the  highest  resoludon  standard  IBM 
mode  widi  two  display  pages.  This  mode  provides  two  display  pages  of  640  x  350  pixels  with 
16  colon.  Hie  driver  routines  can  easily  be  modified  to  w^  with  any  mode  that  supports  two 
display  pages,  including  super  EGA/VGA.  However,  the  graphics  primitives  will  gea^y  not 
work  in  modes  beyond  800  x  600  x  4. 

Graphics  Primitives,  Advanced  Operations,  and  Utility  Routines 
The  development  system  provides  a  wide  variety  of  primitives  udiich  write  directly  to  die 
gnphics  hardware,  and  are  in  general  the  fastest  EGA/VGA  primitives  that  we  know  of.  These 
indude  poinu,  lines,  circle,  elipses,  polygons,  and  clipping.  Advanced  routii»s  include  bitBUt, 
virtual  qnites,  bitplane  operations,  palette  manipulation,  icreen-UHlisk  and  disk-to-screen  copies. 
Many  utility  routines  are  supplied  to  simplify  coordinate  conversion,  math,  use  of  multiple 
monitors,  angle  conversion,  etc.  A  trackball  with  an  additional  pot  for  Z  is  supponed  as  a  ^D 
input  device. 

Tcchnteal  Support  and  Programming  Services 

The  development  system  comes  with  30  days  of  support  Extended  support  packages  are 
available  at  extra  cost  Vision  Research  Graphics  also  provides  cusunn  programming  services. 


pcSTEREOSCOPE  Technical  Description 


What  is  a  Stereoscopic  Display? 

A  stereoscopic  display  provides  separate  images  to  the  left  and  right  eyes.  these  images 
simulate  the  slighly  different  viewpoints  of  our  two  eyes,  the  bnin  will  combine  the  ima  's  sujh 
that  we  see  them  with  an  actual  sensation  of  depth.  This  differs  greiuly  from  stxalied  3D 
displays,  which  use  perspective  cues,  shading  and  superpositioo  to  convey  merely  an  iminession  • 
not  sensation  •  of  depth.  Using  both  schemes  together  provides  the  static  dqpth  cues  aviiLri»le 
in  real  worid  viewing,  and  yields  the  strongest  perception  of  dq>th. 

Theory  of  Operatitm 

The  pcSTEREOSCOPE  woi^  by  time*multiplexing  left-  and  right-eye  images.  The  images  are 
alternated  on  a  CRT  monitor,  while  shutter  glasses  allow  each  eye  to  view  only  die  images 
intended  for  that  eye.  Since  a  standard  monitor  tuns  at  60  Hz,  the  fiame-rate  to  each  eye  is  30 
Hz. 

Hardware  Description  and  Requirements 

The  pcSTEREOSCOPE  consists  of  a  pc  board,  liquid-crystal  shutter  glasses,  and  a  connector. 
The  pc  board  occupies  a  single  8-bit  slot  in  an  IBM  PC^nVAT  or  compatible,  or  in  an  IBM  PS2 
Modd  30.  The  connecaor  is  placed  between  an  EGA/VGA  controller  and  monitor,  and  provides 
a  line  which  carries  the  vertical  sync  signal  to  the  pcSTEREOSOOPE  board.  The  board  detects 
the  sync  pulse  and  interrupts  the  coiiq>uter.  An  interrupt  driver  dten  directs  the  board  to  open 
and  close  the  shutters  over  the  left  ahd  right  eyes,  and  sets  the  frame  buffer  address  to  display 
the  image  to  the  proper  eye. 

The  pcSTEREOSOOPE  works  with  any  EGAA^GA  ctmtroller.  Most  moniton  are  suiable, 
exceptions  being  those  with  long-persistence  phosphon.  Typically  IBM  mode  lOH  is  used  to 
provide  640  x  3S0.  16-color  gnq>hics.  StereoscoiHC  images  are  produced  by  generating  left- 
and  right-eye  images  in  the  two  pages  of  the  di^lay,  and  Oen  turning  on  the  software  driver. 
This  mode  is  extensively  suppol^  in  our  pcSTEREOSCOPE  Strftwaie  Development  System. 
Other  display  modes  may  be  used,  including  super-EGA/VGA  modes,  to  long  as  the  graphics 
board  provides  two  full  ^splay  pages  in  the  desired  mode. 


Vision  Research  Graphics,  inc. 
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Stereo-Snapshot/SVGA 


A  collection  of  (TSR)  utilities  that  allow  EGA,  VGA,  and  Super-VGA  images  to  be 
captured  and  used  in  stereo-pairs.  After  capturing  images  for  the  left  and  right  eyes, 
the  images  may  be  viewed  in  stereo,  using  the  pcSTEREOSCOPE  hardware.  Stereo 
images  can  be  sequenced  from  storage  on  a  hard  drive. 

The  output  of  most  3D  programs  can  be  viewed  in  stereo  by  using  this  program.  It 
works  with  3D  CAD,  solid  modeling,  video  frame  capture,  3D  graphing,  data 
presentation,  and  many  others.  A  public  domain  3D  CAD  program  is  included  to 
demonstrate  Stereo-Snapshot/SVGA. 

This  product  requires  the  pcSTEREOSCOPE  hardware  and  a  Super-VGA  board 
containing  the  Tseng  4000  chipset. 

Modes  supported  are: 

640  X  480  X  16  color 
640  X  480  X  256  color 

800  X  600  X  16  color  — Note:  The  driver  for  this  mode  has  been  written  and 

tested,  but  is  not  yet  implemented.  If  you  want  this 
mode,  there  will  be  a  delay  after  receipt  of  the  PO. 


Note:  800  x  600  x  256  color  would  probably  work  but  has  not  been  tried.  We  will  try 
it  on  a  custom  programming  basis. 


£ii£ss 

Stereo-Snapshot/SVGA  software  $400 
pcSTEREOSCOPE  hardw'are  $450 
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VISION  RESEARCH  GRAPHICS,  inc. 

99  Madbury  Road  •  Durham,  New  Hampshire  03824 
(603)  868-2270  •  FAX  (603)  868-1352 


VISION  RESEARCH  GRAPHICS,  inc. 

99  Madbury  Road  •  Durham,  New  Hampshire  03824 
(603)  868-2270  •  FAX  (603)  868- J  352 

PRICE  LIST 

TM 

pcSTEREOSCOPE 

HARDWARE;  When  ordering,  please  specify  EGA  or  VGA  cable. 

Stereoscopic  Computer  Graphics  Display  System . $500 

Requires  IBM  PC-XT,  PC-AT  or  Compatible  with  EGA/VGA  card  and  monitor 
Package  Includes: 

PC  short -card  display  driver  boatd  (Supp>-rts  5  prs.  of  glasses) 

One  pair  liquid  crystal  shutter  glasses 
One  EGA  or  VGA  adapter  cable 
Hardware  Installation  Instructions 


SOFTWARE;  Please  specify  disk  size:  5.25"  HD,  5.25"  ID.  or  3.5"  HD 
pcSTEREOSCOPE  HAJtDWARE  required  for  all  software. 


TM 

The  MsionLab  . $600 

Package  Includes: 

Over  30  experiments  and  demonstrations 
Laboratory  Manual/  User’s  Manual 
Single  User  License 

VisionLab  with  a  site  license  for  1  extra  station . $1100 

VisionLab  with  a  site  license  for  unlimited  stations  . 31500 

pcSTEREOSCOPE  Software  Development  System . 3350 


Requires  Turbo  C .  2.0  or  Turbo  C+-»- 
Package  Includes: 

C  Source  Code  examples 
Function  Library,  and  driver  source  code 
User’s  Manual/  Programmers’  Reference  Manual 
Single  User  License 

ADDITIONAL  ITEMS  PURCHASED  SEPARATELY: 


The  VisionLab  Manual  . . . $25 

Development  System  Manual . 35 

EGA  Adapter  Cable . 30 

VGA  Adapter  Cable . 35 

Adaptor  for  Multiple  Glasses . 30 

3* Axis  Trackball  . 155 


International  Orders, Consignee  pays  shipping  charges,  duties  and  taxes. 
Domestic  Orders,  Shipping  and  Handling,  $15  for  <  $1500,  $25  for  >  $1500 

MasterCard  and  VISA  accepted.  Prices  are  U.s.  Currency  and  are  subject  to  change. 
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